Evaluating Forecasts of Incident Flu Hospitalizations Using Weighted Interval Scores

Last 2 Forecasts (EW2 - EW3)

Forecast Accuracy

Weekly Accuracy

Comparing Evaluation Metrics

Each point in the plots below represents a specific model. The red point is the ensemble.

Completeness of Submissions

Last 4 Forecasts (EW53 - EW3)

Models which qualified for the ensemble at all time horizons (1, 2, 3, and 4 weeks prior) for each of the last 4 observed weeks in at least 50 locations are included in the following analysis.

Forecast Accuracy

Weekly Accuracy

Comparing Evaluation Metrics

Each point in the plots below represents a specific model. The red point is the ensemble.

Completeness of Submissions

Last 8 Forecasts (EW49 - EW3)

Models which qualified for the ensemble at all time horizons (1, 2, 3, and 4 weeks prior) for each of the last 8 observed weeks in at least 50 locations are included in the following analysis.

Forecast Accuracy

Weekly Accuracy

Comparing Evaluation Metrics

Each point in the plots below represents a specific model. The red point is the ensemble.

Completeness of Submissions

Long-Term Performance

All Models

Season (EW47 - EW3)

Forecast Accuracy

Comparing Evaluation Metrics

Each point in the plots below represents a specific model. The red point is the ensemble.

Completeness of Submissions